Dataset statistics
| Number of variables | 15 |
|---|---|
| Number of observations | 12034 |
| Missing cells | 0 |
| Missing cells (%) | 0.0% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 1.4 MiB |
| Average record size in memory | 120.0 B |
Variable types
| NUM | 9 |
|---|---|
| BOOL | 6 |
Reproduction
| Analysis started | 2020-02-16 03:25:25.350675 |
|---|---|
| Analysis finished | 2020-02-16 03:25:55.109179 |
| Version | pandas-profiling v2.5.0 |
| Command line | pandas_profiling --config_file config.yaml [YOUR_FILE.csv] |
| Download configuration | config.yaml |
company_id is highly correlated with receipt_id and 2 other fields | High Correlation |
receipt_id is highly correlated with company_id and 2 other fields | High Correlation |
matched_transaction_id is highly correlated with receipt_id and 2 other fields | High Correlation |
feature_transaction_id is highly correlated with receipt_id and 2 other fields | High Correlation |
TimeMappingMatch is highly correlated with DifferentPredictedTime | High Correlation |
DifferentPredictedTime is highly correlated with TimeMappingMatch | High Correlation |
DifferentPredictedDate is highly correlated with DateMappingMatch | High Correlation |
DateMappingMatch is highly correlated with DifferentPredictedDate | High Correlation |
PredictedAmountMatch is highly skewed (γ1 = 23.44637336) | Skewed |
DateMappingMatch has 9068 (75.4%) zeros | Zeros |
AmountMappingMatch has 11225 (93.3%) zeros | Zeros |
DescriptionMatch has 11581 (96.2%) zeros | Zeros |
PredictedNameMatch has 11589 (96.3%) zeros | Zeros |
PredictedAmountMatch has 11989 (99.6%) zeros | Zeros |
| Distinct count | 1155 |
|---|---|
| Unique (%) | 9.6% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 27396.26417 |
|---|---|
| Minimum | 10000 |
| Maximum | 50226 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 10000 |
|---|---|
| 5-th percentile | 10057 |
| Q1 | 20057 |
| median | 30105 |
| Q3 | 30343 |
| 95-th percentile | 50129 |
| Maximum | 50226 |
| Range | 40226 |
| Interquartile range (IQR) | 10286 |
Descriptive statistics
| Standard deviation | 12037.59652 |
|---|---|
| Coefficient of variation (CV) | 0.4393882482 |
| Kurtosis | -0.5771494461 |
| Mean | 27396.26417 |
| Median Absolute Deviation (MAD) | 9630.465591 |
| Skewness | 0.2542750523 |
| Sum | 329686643 |
| Variance | 144903730 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[10000. 10000.5 10003.5 10013.5 10063. ... 50212.5 50215.5 50218.5 50222.5 50226. ], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 30393 | 25 | 0.2% | |
| 30081 | 25 | 0.2% | |
| 30303 | 25 | 0.2% | |
| 30177 | 23 | 0.2% | |
| 30053 | 23 | 0.2% | |
| 30203 | 23 | 0.2% | |
| 20032 | 22 | 0.2% | |
| 30235 | 22 | 0.2% | |
| 10165 | 22 | 0.2% | |
| 30139 | 22 | 0.2% | |
| Other values (1145) | 11802 | 98.1% |
| Value | Count | Frequency (%) | |
| 10000 | 20 | 0.2% | |
| 10001 | 7 | 0.1% | |
| 10002 | 7 | 0.1% | |
| 10003 | 8 | 0.1% | |
| 10004 | 20 | 0.2% |
| Value | Count | Frequency (%) | |
| 50226 | 7 | 0.1% | |
| 50225 | 20 | 0.2% | |
| 50224 | 12 | 0.1% | |
| 50223 | 14 | 0.1% | |
| 50222 | 2 | < 0.1% |
| Distinct count | 5 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 27247.79791 |
|---|---|
| Minimum | 10000 |
| Maximum | 50000 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 10000 |
|---|---|
| 5-th percentile | 10000 |
| Q1 | 20000 |
| median | 30000 |
| Q3 | 30000 |
| 95-th percentile | 50000 |
| Maximum | 50000 |
| Range | 40000 |
| Interquartile range (IQR) | 10000 |
Descriptive statistics
| Standard deviation | 12024.54299 |
|---|---|
| Coefficient of variation (CV) | 0.4413032946 |
| Kurtosis | -0.5670587709 |
| Mean | 27247.79791 |
| Median Absolute Deviation (MAD) | 9599.982201 |
| Skewness | 0.2627528486 |
| Sum | 327900000 |
| Variance | 144589634.1 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[10000. 25000. 35000. 45000. 50000.], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 30000 | 4926 | 40.9% | |
| 20000 | 2375 | 19.7% | |
| 10000 | 2351 | 19.5% | |
| 50000 | 1383 | 11.5% | |
| 40000 | 999 | 8.3% |
| Value | Count | Frequency (%) | |
| 10000 | 2351 | 19.5% | |
| 20000 | 2375 | 19.7% | |
| 30000 | 4926 | 40.9% | |
| 40000 | 999 | 8.3% | |
| 50000 | 1383 | 11.5% |
| Value | Count | Frequency (%) | |
| 50000 | 1383 | 11.5% | |
| 40000 | 999 | 8.3% | |
| 30000 | 4926 | 40.9% | |
| 20000 | 2375 | 19.7% | |
| 10000 | 2351 | 19.5% |
| Distinct count | 1155 |
|---|---|
| Unique (%) | 9.6% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 27773.90818 |
|---|---|
| Minimum | 10112 |
| Maximum | 50408 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 10112 |
|---|---|
| 5-th percentile | 10294 |
| Q1 | 20259 |
| median | 30524 |
| Q3 | 31318 |
| 95-th percentile | 50224.35 |
| Maximum | 50408 |
| Range | 40296 |
| Interquartile range (IQR) | 11059 |
Descriptive statistics
| Standard deviation | 12014.61197 |
|---|---|
| Coefficient of variation (CV) | 0.4325862926 |
| Kurtosis | -0.6242298912 |
| Mean | 27773.90818 |
| Median Absolute Deviation (MAD) | 9711.056015 |
| Skewness | 0.2123450504 |
| Sum | 334231211 |
| Variance | 144350900.8 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[10112. 10115.5 10123.5 10125.5 10136. ... 50345. 50358.5 50373. 50407.5 50408. ], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 31463 | 25 | 0.2% | |
| 31462 | 25 | 0.2% | |
| 31460 | 25 | 0.2% | |
| 30402 | 23 | 0.2% | |
| 30395 | 23 | 0.2% | |
| 30398 | 23 | 0.2% | |
| 31121 | 22 | 0.2% | |
| 10331 | 22 | 0.2% | |
| 30393 | 22 | 0.2% | |
| 20265 | 22 | 0.2% | |
| Other values (1145) | 11802 | 98.1% |
| Value | Count | Frequency (%) | |
| 10112 | 6 | < 0.1% | |
| 10113 | 6 | < 0.1% | |
| 10114 | 20 | 0.2% | |
| 10115 | 20 | 0.2% | |
| 10116 | 4 | < 0.1% |
| Value | Count | Frequency (%) | |
| 50408 | 7 | 0.1% | |
| 50407 | 7 | 0.1% | |
| 50379 | 2 | < 0.1% | |
| 50378 | 2 | < 0.1% | |
| 50376 | 2 | < 0.1% |
| Distinct count | 2132 |
|---|---|
| Unique (%) | 17.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 27547.60894 |
|---|---|
| Minimum | 10000 |
| Maximum | 50413 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 10000 |
|---|---|
| 5-th percentile | 10019 |
| Q1 | 20010 |
| median | 30104 |
| Q3 | 31109 |
| 95-th percentile | 50144 |
| Maximum | 50413 |
| Range | 40413 |
| Interquartile range (IQR) | 11099 |
Descriptive statistics
| Standard deviation | 12037.73407 |
|---|---|
| Coefficient of variation (CV) | 0.436979271 |
| Kurtosis | -0.6063972023 |
| Mean | 27547.60894 |
| Median Absolute Deviation (MAD) | 9690.125122 |
| Skewness | 0.2337546208 |
| Sum | 331507926 |
| Variance | 144907041.6 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[10000. 10000.5 10010.5 10017.5 10028.5 ... 50327. 50340.5 50369.5 50407.5 50413. ], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 30003 | 117 | 1.0% | |
| 30002 | 117 | 1.0% | |
| 30077 | 116 | 1.0% | |
| 30078 | 115 | 1.0% | |
| 30158 | 115 | 1.0% | |
| 30159 | 114 | 0.9% | |
| 30071 | 114 | 0.9% | |
| 30083 | 114 | 0.9% | |
| 30012 | 114 | 0.9% | |
| 30096 | 112 | 0.9% | |
| Other values (2122) | 10886 | 90.5% |
| Value | Count | Frequency (%) | |
| 10000 | 53 | 0.4% | |
| 10001 | 52 | 0.4% | |
| 10003 | 52 | 0.4% | |
| 10004 | 52 | 0.4% | |
| 10005 | 52 | 0.4% |
| Value | Count | Frequency (%) | |
| 50413 | 2 | < 0.1% | |
| 50412 | 2 | < 0.1% | |
| 50411 | 2 | < 0.1% | |
| 50410 | 2 | < 0.1% | |
| 50409 | 2 | < 0.1% |
| Distinct count | 11 |
|---|---|
| Unique (%) | 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.2179013628 |
|---|---|
| Minimum | 0 |
| Maximum | 1 |
| Zeros | 9068 |
| Zeros (%) | 75.4% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 0.95 |
| Maximum | 1 |
| Range | 1 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.3845348501 |
|---|---|
| Coefficient of variation (CV) | 1.764719803 |
| Kurtosis | -0.429122464 |
| Mean | 0.2179013628 |
| Median Absolute Deviation (MAD) | 0.3283911514 |
| Skewness | 1.23023108 |
| Sum | 2622.225 |
| Variance | 0.1478670509 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[0. 0.5375 0.6 0.6875 0.7375 ... 0.8375 0.875 0.925 0.975 1. ], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 0 | 9068 | 75.4% | |
| 0.95 | 1636 | 13.6% | |
| 0.85 | 571 | 4.7% | |
| 0.9 | 217 | 1.8% | |
| 0.65 | 194 | 1.6% | |
| 0.825 | 179 | 1.5% | |
| 0.55 | 98 | 0.8% | |
| 1 | 36 | 0.3% | |
| 0.75 | 21 | 0.2% | |
| 0.525 | 11 | 0.1% |
| Value | Count | Frequency (%) | |
| 0 | 9068 | 75.4% | |
| 0.525 | 11 | 0.1% | |
| 0.55 | 98 | 0.8% | |
| 0.65 | 194 | 1.6% | |
| 0.725 | 3 | < 0.1% |
| Value | Count | Frequency (%) | |
| 1 | 36 | 0.3% | |
| 0.95 | 1636 | 13.6% | |
| 0.9 | 217 | 1.8% | |
| 0.85 | 571 | 4.7% | |
| 0.825 | 179 | 1.5% |
| Distinct count | 5 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.03166029583 |
|---|---|
| Minimum | 0 |
| Maximum | 0.9 |
| Zeros | 11225 |
| Zeros (%) | 93.3% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 0.4 |
| Maximum | 0.9 |
| Range | 0.9 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.1226109442 |
|---|---|
| Coefficient of variation (CV) | 3.872703681 |
| Kurtosis | 15.71977645 |
| Mean | 0.03166029583 |
| Median Absolute Deviation (MAD) | 0.05906378938 |
| Skewness | 3.991207947 |
| Sum | 381 |
| Variance | 0.01503344364 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[0. 0.5 0.65 0.8 0.9 ], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 0 | 11225 | 93.3% | |
| 0.4 | 615 | 5.1% | |
| 0.7 | 159 | 1.3% | |
| 0.6 | 26 | 0.2% | |
| 0.9 | 9 | 0.1% |
| Value | Count | Frequency (%) | |
| 0 | 11225 | 93.3% | |
| 0.4 | 615 | 5.1% | |
| 0.6 | 26 | 0.2% | |
| 0.7 | 159 | 1.3% | |
| 0.9 | 9 | 0.1% |
| Value | Count | Frequency (%) | |
| 0.9 | 9 | 0.1% | |
| 0.7 | 159 | 1.3% | |
| 0.6 | 26 | 0.2% | |
| 0.4 | 615 | 5.1% | |
| 0 | 11225 | 93.3% |
| Distinct count | 5 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.02152235333 |
|---|---|
| Minimum | 0 |
| Maximum | 0.8 |
| Zeros | 11581 |
| Zeros (%) | 96.2% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 0 |
| Maximum | 0.8 |
| Range | 0.8 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.1169950184 |
|---|---|
| Coefficient of variation (CV) | 5.435977032 |
| Kurtosis | 32.76678298 |
| Mean | 0.02152235333 |
| Median Absolute Deviation (MAD) | 0.04142435997 |
| Skewness | 5.742049975 |
| Sum | 259 |
| Variance | 0.01368783433 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[0. 0.3 0.5 0.7 0.8], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 0 | 11581 | 96.2% | |
| 0.8 | 193 | 1.6% | |
| 0.4 | 143 | 1.2% | |
| 0.6 | 60 | 0.5% | |
| 0.2 | 57 | 0.5% |
| Value | Count | Frequency (%) | |
| 0 | 11581 | 96.2% | |
| 0.2 | 57 | 0.5% | |
| 0.4 | 143 | 1.2% | |
| 0.6 | 60 | 0.5% | |
| 0.8 | 193 | 1.6% |
| Value | Count | Frequency (%) | |
| 0.8 | 193 | 1.6% | |
| 0.6 | 60 | 0.5% | |
| 0.4 | 143 | 1.2% | |
| 0.2 | 57 | 0.5% | |
| 0 | 11581 | 96.2% |
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 94.1 KiB |
| 1 | |
|---|---|
| 0 | 163 |
| Value | Count | Frequency (%) | |
| 1 | 11871 | 98.6% | |
| 0 | 163 | 1.4% |
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 94.1 KiB |
| 0 | |
|---|---|
| 1 | 167 |
| Value | Count | Frequency (%) | |
| 0 | 11867 | 98.6% | |
| 1 | 167 | 1.4% |
| Distinct count | 5 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.02421472495 |
|---|---|
| Minimum | 0 |
| Maximum | 0.8 |
| Zeros | 11589 |
| Zeros (%) | 96.3% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 0 |
| Maximum | 0.8 |
| Range | 0.8 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.1286460537 |
|---|---|
| Coefficient of variation (CV) | 5.312720007 |
| Kurtosis | 27.95876714 |
| Mean | 0.02421472495 |
| Median Absolute Deviation (MAD) | 0.04663859854 |
| Skewness | 5.38729344 |
| Sum | 291.4 |
| Variance | 0.01654980713 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[0. 0.1 0.3 0.7 0.8], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 0 | 11589 | 96.3% | |
| 0.8 | 251 | 2.1% | |
| 0.4 | 91 | 0.8% | |
| 0.6 | 84 | 0.7% | |
| 0.2 | 19 | 0.2% |
| Value | Count | Frequency (%) | |
| 0 | 11589 | 96.3% | |
| 0.2 | 19 | 0.2% | |
| 0.4 | 91 | 0.8% | |
| 0.6 | 84 | 0.7% | |
| 0.8 | 251 | 2.1% |
| Value | Count | Frequency (%) | |
| 0.8 | 251 | 2.1% | |
| 0.6 | 84 | 0.7% | |
| 0.4 | 91 | 0.8% | |
| 0.2 | 19 | 0.2% | |
| 0 | 11589 | 96.3% |
ShortNameMatch
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 94.1 KiB |
| 0 | |
|---|---|
| 1 | 456 |
| Value | Count | Frequency (%) | |
| 0 | 11578 | 96.2% | |
| 1 | 456 | 3.8% |
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 94.1 KiB |
| 1 | |
|---|---|
| 0 |
| Value | Count | Frequency (%) | |
| 1 | 9068 | 75.4% | |
| 0 | 2966 | 24.6% |
| Distinct count | 6 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.001005484461 |
|---|---|
| Minimum | 0 |
| Maximum | 0.6 |
| Zeros | 11989 |
| Zeros (%) | 99.6% |
| Memory size | 94.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 0 |
| Maximum | 0.6 |
| Range | 0.6 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.02013383633 |
|---|---|
| Coefficient of variation (CV) | 20.0240154 |
| Kurtosis | 579.2907206 |
| Mean | 0.001005484461 |
| Median Absolute Deviation (MAD) | 0.002003449094 |
| Skewness | 23.44637336 |
| Sum | 12.1 |
| Variance | 0.0004053713652 |
Histogram with fixed size bins (bins=10)
Histogram with variable size bins (bins=[0. 0.05 0.15 0.3 0.6 ], "bayesian blocks" binning strategy used)
| Value | Count | Frequency (%) | |
| 0 | 11989 | 99.6% | |
| 0.1 | 24 | 0.2% | |
| 0.5 | 9 | 0.1% | |
| 0.4 | 8 | 0.1% | |
| 0.6 | 3 | < 0.1% | |
| 0.2 | 1 | < 0.1% |
| Value | Count | Frequency (%) | |
| 0 | 11989 | 99.6% | |
| 0.1 | 24 | 0.2% | |
| 0.2 | 1 | < 0.1% | |
| 0.4 | 8 | 0.1% | |
| 0.5 | 9 | 0.1% |
| Value | Count | Frequency (%) | |
| 0.6 | 3 | < 0.1% | |
| 0.5 | 9 | 0.1% | |
| 0.4 | 8 | 0.1% | |
| 0.2 | 1 | < 0.1% | |
| 0.1 | 24 | 0.2% |
PredictedTimeCloseMatch
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 94.1 KiB |
| 0 | |
|---|---|
| 1 | 921 |
| Value | Count | Frequency (%) | |
| 0 | 11113 | 92.3% | |
| 1 | 921 | 7.7% |
flag_match
Boolean
| Distinct count | 2 |
|---|---|
| Unique (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 94.1 KiB |
| 0 | |
|---|---|
| 1 | 857 |
| Value | Count | Frequency (%) | |
| 0 | 11177 | 92.9% | |
| 1 | 857 | 7.1% |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
First rows
| receipt_id | company_id | matched_transaction_id | feature_transaction_id | DateMappingMatch | AmountMappingMatch | DescriptionMatch | DifferentPredictedTime | TimeMappingMatch | PredictedNameMatch | ShortNameMatch | DifferentPredictedDate | PredictedAmountMatch | PredictedTimeCloseMatch | flag_match | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 10000 | 10000 | 10468 | 10000 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 1 | 10000 | 10000 | 10468 | 10001 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 2 | 10000 | 10000 | 10468 | 10003 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 3 | 10000 | 10000 | 10468 | 10004 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 4 | 10000 | 10000 | 10468 | 10005 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 5 | 10000 | 10000 | 10468 | 10006 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 6 | 10000 | 10000 | 10468 | 10008 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 7 | 10000 | 10000 | 10468 | 10009 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 8 | 10000 | 10000 | 10468 | 10010 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 9 | 10000 | 10000 | 10468 | 10011 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
Last rows
| receipt_id | company_id | matched_transaction_id | feature_transaction_id | DateMappingMatch | AmountMappingMatch | DescriptionMatch | DifferentPredictedTime | TimeMappingMatch | PredictedNameMatch | ShortNameMatch | DifferentPredictedDate | PredictedAmountMatch | PredictedTimeCloseMatch | flag_match | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 12024 | 50225 | 50000 | 50037 | 50022 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 12025 | 50225 | 50000 | 50037 | 50024 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 12026 | 50225 | 50000 | 50037 | 50026 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 12027 | 50226 | 50000 | 50368 | 50070 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 12028 | 50226 | 50000 | 50368 | 50072 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 12029 | 50226 | 50000 | 50368 | 50074 | 0.65 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0 |
| 12030 | 50226 | 50000 | 50368 | 50075 | 0.65 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0 |
| 12031 | 50226 | 50000 | 50368 | 50366 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 1.0 | 0 |
| 12032 | 50226 | 50000 | 50368 | 50367 | 0.00 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0 |
| 12033 | 50226 | 50000 | 50368 | 50368 | 0.95 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 1 |